Do we also want concurrency for different chunk sizes?

Do we also want concurrency for different chunk sizes?

That would be nice, if the chunk sizes are somewhat compatible, i.e. one is a multiple of the other.

• (Is there some measure to prevent this that I am not aware of?)

if you are trying to write K input chunks into M output chunks, you can partition your K chunks into sets, where within each set elements can be written independently from all the other elements. then you write each set one after another. in the worst case scenario there will be 1 set per chunk, but you are guaranteed to avoid write collisions this way.

one question to answer here is what "auto" means for chunks if the user passes in a chunked array, but they want to use zarr-python's auto-chunking instead of the chunks that came with the array.

We might want to use a separate value that means "copy the chunks this object already has", which is distinct from "generate some chunks using the chunking heuristics". maybe something like ChunksLike: Literal['auto'] | Literal['keep'] | ShapeLike?

one question to answer here is what "auto" means for chunks if the user passes in a chunked array, but they want to use zarr-python's auto-chunking instead of the chunks that came with the array.

Good point! I like the idea of distinguishing between keep and auto.